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Correlations between the surface refractivity, Ns, and transhorizon recordings of VHF 
radio transmission loss are examined for 34 U.S. and 9 German radio paths. The largest 
correlations are found to be associated with the seasonal cycle of nighttime recordings and 
diurnal cycles during the summer months. The annual cycles may be represented by a single 
regression coefficient of —0.18 db/Ns for either night or day. The regression coefficients for 
the diurnal cycles lie between —0.2 and —1.1 db/km and vary with distance and season, 
being greatest between 175 and 200 kilometers and in thc^ winter months. A promising 
method of estimating the within-nionth distrihution of hourly median transmission loss is 
suggested by combining the seasonal and diurnal correlation analysis. It is indicated that 
Ns provides as useful a ])rediction of diin*nal and seasonal variations of monthly median 
valuers of transmission loss as radio measurements made over the actual radio path in 
])nn'ious years. 



1. Introduction 

Radio pliysicists have long sought a dcpendaUe 
relationshi]) between recorded transhorizon trans- 
mission loss and atniospJieiie ])roperties. The sur- 
face value of the radio refractivity at tnidpatli, Ns, 
has received much study. Pickard and Stetson 
[1950a, b] noted a strong correlation between 
monthly Jiuulian values of both variables. Bean 
[1956] found that tJiis correlation deteriorated with 
decreasing averaging time, being about 0.9 for 
monthly averages, 0.7 for 5-day averages and 0.5 for 
daily averages. Further studies have sliown a high 
degree of correspondence between hour-to-hour varia- 
tions of transmission loss and median scale weather 
events [Moler and Arvola, 1956; Moler and Holden, 
I960]. To date the practical application of radio 
meteorological correlation has been to predict the 
path-to-path, or geographical variation of long-term 
transmission loss. The present study is directed 
towards estimating the variation of hourly median 
transmission loss over individual paths. 

All of tlie above climatic studies are concerned 
with correlation of annual C3^cles as this paper will 
also be. However, the correlation of diurnal cycles 
will also be investigated with a view towards estimat- 
ing the within-month variation of transmission loss. 
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2. Radio and Meteorological Data 

Hourly median transmission loss values were 
examined for the 34 different U.S. and 9 German 
stations listed in appendix 1. In general the data 
for eacli pi'opagation i)a(h are recorded for at least 
2 yr and a minimum of 8 lir per day. Monthly 
median values of transmission loss, Z^, were prepared 
for each liour of the broadcast day for eacli month. 

Botli seasonal and diurnal trends were immediately 
apparent in these monthly medians. Figure 1 gives 
examples of these trends for two stations, WCSI- 
FM, path number 11 (Columbus, Indiana-Urbana, 
111.) and KIXL-FM, path number 3 (Dallas- 
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Figure 1. Examples of seasonal and diurnal cycles of monthly 
median transmission loss. 
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Austin, Tex.). A consistent pattern was found on 
all such data plots. The seasonal cycle for the 
nighttime and early morning hours is much more 
pronounced than for the midafternoon hours. Mid- 
afternoon, however, appears to have more nearly 
uniform propagation conditions throughout the year. 
It appears quite significant that the diurnal cycles 
are so similar year-to-year rather than month-to- 
month within the same year. This last observation 
dominates the analysis of this paper. First, cor- 
relation of monthly median diurnal and seasonal 
cycles will be derived. Second, the statistics of 
these correlations will be analyzed, trends deduced 
and, third, these trends will then be applied to the 
analysis of hour-to-hour variation of transmission 
loss within the month. 

Using standard statistical techniques, the correla- 
tion of seasonal cycles of monthly median trans- 
mission loss with monthly average values of the 
surface refractivity, Ns, were derived. At first 
sight these correlations had no discernible pattern. 
It seemed advisable to examine these correlation 
coefficients in terms of some pertinent measure of 
propagation characteristics. The standard devia- 
tion of the measured transmission losses, s(Z?,), was 
used as such a measure. The correlation coefficients 
of seasonal and diurnal cycles are shown on figures 
2 to 5. The average correlation coefficient was 
estimated through the use of Fisher's z [Snedecor, 
1946] applied within small intervals of s{Lb). 
Prior to the analysis it was decided to give no weight 
to the correlations associated with s(Li,) <2 db since 
this represents the opinion of the International 
Consultative Committee for Radio (CCIR) [1959a] 
as to the order of magnitude of the error of measure- 
ment of ift. One reaches several conclusions from 
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Figure 2. Correlation coefficients of seasonal cycles of Ng and 
Lb: midday (1200, I4OO, 1600) versus the standard deviation 



figures 2 to 5. The correlation coefficients appear to 
scatter to the point of insignificance within the region 
s{Li,) <2 db. Of course the correlation coefficients 
are systematically greater the more s(Li,) exceeds 
2 db. It follows, then, that the largest correlation 
coefficients are found with the most pronounced 
cycles of transmission loss; i.e., the seasonal cycle 
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Figure 3. Correlation of coefficients of seasonal cycles 0/ Ng 
and Lb: night {2000, 2200, 2400) versus the standard devia- 
tion of Lb. 
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Figure 4. Correlation coefficients of diurnal cycles of Ng^'and 
Lb: winter (Dec, Jan., Feb.) versus the standard deviation 
of Lb. 
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standard deviation of Lb. 



of nio'httime recordings and tlie summer time 
diurnal cycles. 

For practical applications one wishes to deter- 
mine the regression coefFicient, 6, in the least- 
squares derived regression lino 



L,=^bNs+a. 



(1) 



The regression coefficient gives the sensitivity of Li, 
to a unit change in Ns. The intercept, a, is a 
function of path characteristics such as antenna 
heights, distance, and terrain. For practical appli- 
cations the intercept is best obtained from available 
prediction processes such as those of Rice, Longley, 
and Norton [1959]. The regression coefficients for 
the seasonal cycles seemed sufficiently independent 
of propagation path characteristics that a simple 
average of —0.18 db per unit change in Ng was 
adopted, figure 6, by neglecting the values associated 
with.9(ift)<2 db. 

The regression coefficients associated with the 
diurnal cycle, however, appear to be better described 
in terms of distance and time of year. The diurnal 
regression coefficients for s{Lb) >2 db were plotted 
versus distance for each month of the year. A 
curve through the data points was determined 
visually. The scatter of points about the resultant 
curves was comparable to that of figure 6. A com- 
parison of the individual montlily curves revealed 
that several months could be combined so that only 
tln-ee curves are needed: winter (December-February) , 
spring (Alarch-May), summer-fall (June-November). 



These curves are shown on figure 7. The peak of 
the summer-fall curves are near 200 km as compared 
to 175 km for the winter- time curves in keeping 
with the general extension of the radio horizon in 
the warmer months. [See for example the CCIR 
curves of AA^/km, [1959b].] Although the summer 
peak is lower than the winter peak the observed 
diurnal range of A^^ is greater in the sununer with 
resultant greater range of L^. 
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Figure 6. Regression coefficients of seasonal cycles of monthly 
median Lb upon Ng/or both day and night versus the standard 
deviation of Lb. 
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Figure 7. Variability of regression coefficient of diurnal change 
of monthly median Lb upon Ng versus both distance and 
month of year. 
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3. Within-Month Variation of Hourly Median 



The above observations suggest a basis for de- 
veloping a method for estimating the within month 
variation of L^ that might perhaps be eventually 
useful in practical prediction processes. 

The value of the intercept in (1) could be obtained 
by a variety of existing prediction methods, but for 
the purpose of this demonstration it will be assumed 
to be identically the observed February monthly 
median value of Ljy for the hour 1400 for each radio 
path. The value of Z^, at 1400 for any other month 
is then 

L,{M, 1400) = -0.18[A^,(M,, 1400) (2) 

-iV,(reb., 1400)] + a 

(1<'^<12) 
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Figure 8. Comparison of observed lO-to-90 percent within- 
month variation of hourly median transmission loss with 
values predicted from eq (3) for WHKC-FM. 

[Broadcast day: 0600-0100.] 
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Figure 9. Comparison of observed lO-to-90 percent within- 
month variation of hourly median transmission loss with 
values predicted from eq {3) KIXL-FM. 

[Broadcast day: 24 hr.] 



where the notation Mf indicates the month of the 
year. To obtain the value of Li, at any hour, hjy 
within any month one evaluates 



L,(M,,hj) = L,(M„ 1400) + 

bj[N,(M„hj)- 

(l<i<24) 



-iV,(M,, 1400)] (3) 



where bj is the appropriate value of the regression 
coefficient obtained from figure 7. Equation (3) 
allows one to estimate the monthly median value of 
Lj) for any given hour of the day and month of the 
year. Equation (3) may also be used to estimate 
the within-month variation of individual hourly 
median L^ by assuming that this variation is due to 
the superposition of the individual daih^ diurnal 
cycles of L^. For any given path and month the 
regression coefficients in (3) are constant and one 
need onh- determine the desired range of within- 
month variation of Ns, insert this into eq (3) and 
then obtain an estimate of the expected within- 
month variation of Z^. Thus, for example, the 
insertion of the 10 to 90 percent within-month range 
of Ns into (3) yields an estimate of tlie 10 to 90 per- 
cent within-month range of Z^. Examples of this 
procedure are given on figures 8 and 9 for the same 
two radio paths wliose annual and diurnal cycles 
were shown in figure 1. The predicted median 
within-month level of Z^ appears to follow that of 
the observed data. The predicted 10 to 90 percent 
ranges of L^ are larger than the observed ranges for 
KIXL-FM and smaUer than those of WHKC-FM. 
This is actually encouraging since one would wish 
a prediction process to bracket the observed values 
when applied to individual examples. Five U.S. 
radio paths were selected as a quantitative measure 
of the agreement between observed and predicted 
10 to 90 percent ranges. These paths (numbers 3, 
7, 9, 16, and 23 of appendix 1) cover a wide range of 
climate and radio propagation path conditions. 
The predicted 10 to 90 percent ranges were calculated 
in two separate ways. First, the smootlied regres- 
sion coefficients, called hsm, hereafter, were obtained 
from figure 7 and used in conjunction witli published 
long-term distributions of A^, [Bean, Horn, and 
Ozanich, 1960] and, secondly, the observed regression 
coefficients for each path were used with the actual 
A^ distributions for each month of radio record. 
The results are shown on figure 10. Both methods 
of prediction agree within 5 db at the ^0 percent 
level but the total range is noticeably smaller from 
the hsm and long-term Ns combhiation. One 
surmises that this is due, perhaps, to the similarity 
of space averaging of A^ conditions by the radio 
waves traversing the entire radio path and the time 
averaging of the increased meteoi'ological record 
used in the long-term distributions of A^. Similar 
arguments may be applied to hsm- The nine German 
paths also held the same conclusion. These data 
are shown for both the 50 to 90 percent range and 
the 10 to 50 percent range on figures 11 and 12. 

From the above one concludes the correlation of 
Zft and Ns'. 
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(1) increases witli inrroasino- variation of Z^ or iV^; 

(2) is greater for seasonal cycles of the nighttime 
values of the variables than for the midday values; 

(3) is greater for tlie diurnal cycles during the 
summer months than for those in the winter months. 

Further, conclusions (l)-(3) indicate promise for a 
method of estimating the witlun-month variation of 
hourly median field strengths. 

Although these conclusions are for a limited 
sample, one would expect those pertaining to the 
correlation coefficients to be generally observed. 
The development of a prediction method analogous 
to the above must carefully account for the complex 
sensitivity of Z& to changes in Ns. This could 
include a consideration of season, climatic region, 
distance, and frequency. 

One can perhaps see in the above analysis the roots 
of the controversy [Misme, 1960] over tlie utility of 
Ns as a field strength predictor. If an experimenter 
had available transmission loss data for only the 
afternoon hours, lie would conclude that the practical 
utility of the correlation is indeed suspect. The 
same would be true if his radio data were obtained 
in an area where the variation of i& was character- 
istically close to measurement error. This is ap- 
parently the case for western Europe since the 
German data on figures 2 to 5 tend to lie within the 
estimated measurement error. 

One is encouraged in this view by the climatic 
behavior of N,^.. Since these correlations are presum- 
ably due to refractive effects, one would expect the 
correlation coefficients to be systematically greater 
the greater the range of Ng. The animal range of 
monthly mean values of iV^ is 10 to 15 A^ units for 
western Europe and 50 A^ units for the eastern 
United States [Bean and Horn, 1959]. The small 
range of monthly mean values in western Europe 
arises from the steady onshore flow of maritime air 
throughout the year while the large range of the 
eastern U.S. arises from the frequent intrusion of 
such diverse air masses as polar air in the winter and 
tropical air in the summer. 

One may surmise that the marked distance 
dependence of regression coefficient is not independ- 
ent of propagation mechanism. For example, it is 
commonly observed that the greatest range of 
VHF radio fields is observed beyond the radio horizon 
in the region where diffracted and scattered radio 
field strengths are of about equal magnitude. This 
is also a region where increased radio field strengths 
are frequently associated with low-level super- 
refractive layers and elevated reflecting layers. It 
is not unreasonable to associate the relatively large 
values of b with a combination of sensitivity of 
diffracted field strengths to refractive changes plus 
occasional strong superrefraction. Well beyond the 
horizon, however, scattering is assumed to be the 
predominant cause of weak fields, and, since this 
mode of propagation is relatively constant in mean 
level, one assumes that the relatively low value of 
b is due to the insensitivity of this mechanism to 
refraction chano-es. 
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minus observed within-month SO-to-90 percent range of 
Lb for 6 German test paths. 
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minus observed within-month lO-to-50 percent range of 
Lb for 6 German test paths. 
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4. Analysis of Results 

The conclusions reached above are dependent 
upon the choice of statistical model. Although 
both variables are subject to observational errors, 
the standard regression analysis used assumes that 
the independent variable, A^.,, is known exactly and 
that only the dependent variable, L&, is in error. 
In practice this assumption assigns any error in 
Ns to Lf), We shall examine this assumption. 

The rms error in Ns due to errors in meteorological 
measurements, s{Ns)m, may be evaluated from the 
expression 



'(-...={(f-)+(f-)"+(^-)'; 



(4) 



by assuming that there is no correlation between 
the various errors of measurement. For normal 
conditions (T^15 °C, RH=QO%, P=1013 mb) 
^(N's)m is about 1 A^ unit. There is an additional 
error in the mean arising from serial correlation of 
successive observations of Ng. The error in the long 
term mean value of A^^is estimated from the expression 



.w-^^^''^ 



Vi 



(5) 



where s(Ns) indicates the error of the mean and 
s(Ns) the standard devia^tion of the p individual 
values used to determine A^^. The effective number 
of independent observations (free of serial correla- 
tion) is J. 

The value of j is determined by examination of 
the serial correlation within the data. Examination 
of the data indicates it to be approximately described 

by 

r~(r)\k=l,2,3,.,.,p, (6) 

where r^ is the serial correlation coefficient for the 
lag k. By assuming that 

r=ri 

the effective number of independent observations 
may be estimated as [Brooks and Carruthers, 1953] 



J=P 



1+ri 



(7) 



where p is the total number of observed values of A^^. 
Even when so accounting for the effect of serial cor- 
relation upon the error of the mean it is seen from 
table 1 that this standard error will be less than 2.5 
A^ units. The important statistic, 



s\Ns) 



100%, 



is also listed in table 1 and is seen to be no more 
than 4 percent which is taken to be sufficiently small 
as to warrant the adoption of regression analysis for 
the present stud}^. 



The errors of observation of L^ are unknown and 
could easily be smaller than the arbitrary value of 
2 db of standard error adopted here. Fortunately, 
however, practical applications require the regression 
coefficient, 

covariance (Lien's) 

which is independent of errors in L^ and thus is not 
affected by the arbitrary choice of a value of s^{Lj)), 

Table 1. — Effect of serial correlation upon the error in the long 
term mean values of Ns 





(All data for May 1200 local time) 


station 




s{Ns) 
(N units) 


'' 


s(Ns) 


fi^^-^^Y^,, 




r=0 


r=ri 


Washington, D.C... 
Denver, Colorado. __ 





19.1 
14.1 
5.9 
9.7 


0.54 
.40 
.38 
.56 


1.30 

0.96 

.40 

.66 


2.4 
1.46 
0.62 
1.24 


Percent 
1.8 
1.6 


Tatoosh Is., Wash 

San Diego, Calif 


3.9 
2.7 







Note: Assuming that s^i]SFs)m=l A'^unit and r=ru 

Although the brief analysis above justifies the 
statistical treatment used in this study one is left 
with the question of the relative utility of Ns as a 
predictor. A simple test was devised to shed light 
on this question. Those radio paths for which more 
than 1 yr of observations were available were broken 
into two parts (a) the first year of observation and (b) 
all subsequent years. The monthly mean values of 
Ld from the first year were then correlated with the 
data of subsequent years. Monthly mean values of 
Ns were also correlated with the radio data from the 
subsequent years. As before, correlations were per- 
formed on both seasonal and diurnal variations. The 
results of this comparison, shown in table 2, clearly 

and Lb as predictors of variations 
of Lb 



Table 2. Utility of Ns 





Number of data sets 




Diurnal 
variations 


Seasonal 
variations 


Case I: Residual error of prediction of Z6 versus Lb 
less than Lb Yevsvis JSFs . __ ... ... 


16 
18 


16 


Case II: Residual error of prediction of Zb versus Ng 
less than Lb versus hi 


26 







Note: Lb data restricted to those cases where s(Ijb)>2 db. 

indicate that Ns appears to be as useful a predictor of 
diurnal and seasonal variations of monthly median 
values of Lb as radio measurements made over the actual 
radio path. This last observation, although derived 
from limited observations, has far-reaching impli- 
cations for the communications engineer should it be 
found to be universallv true. 



The authors express their appreciation to Mr. CM. 
Miller for his careful collation of the data used in this 
study and tireless verification of seemingly spurious 
data. 
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5. Appendix 1. Radio and Meteorological Data 



Radio station and path 



1. KDKA-FM Pittsburgh-Hudson, Ohio... 

2. KFOR-FM Lincoln-Grand Island 

3. KIXL-FM Dallas-Austin 

4. KLTI Longview-Austin 

5. KPRC-FM Houston-Austin 

6. KW'KH-FM Shrcveport-Austin 

7. KXOK-FM St. Louis-Urbana 

8. KXYZ-FM Houston- Austin 

9. WCAC-FM Anderson, S.C.-PowderSpgs., 

Ga. 

10. WCOL-FM Columbus-Hudson, Ohio 

11. WCSI-FM Columbus, Ind.-Urbana, 111— 

12. WEST-FM Easton-State College 

13. WEVD-FM N.Y. City-Millis, Mass 

14. WHDL-FM Olean-St. College 

15. WHKC-FM Columbus, Ohio-Hudson, 

Ohio. 

16. WHKC-FM Columbus-Hudson, Ohio..- 

17. WHKC-FiM Columbus-Hudson, Ohio 

18. WHOO-FM Ft. Lauderdale 

19. WIP-FAi Philadelpliia-Laurel, Md 

20. WJAS-FM I'itlshur^h-Slate College 

21. WJR-FM Dclroit-iludson 

22. WMBI-FM ('hicag()-rrl)ana 

23. WTIC-FM llartfoid-Millis 

24. KPRC-TV llouslon-.Vustin 

25. WAFM-TV liirniingham-Powder Spgs 

26. WBKB-TV Chicago-Urbana 

27. WENR-TV Chicago-Urbana 

28. WFAA-TV Dallas-Austin 

29. WGN-TV-1 Chicago-Urbana 

30. WGN-TV-2 Chicago-Urbana 

31. WGN-TV-3 (niicasro-Ur))aiia 

32. WGN-TV'-4 Chicago-Urbana 

33. WXYZ-TV Detroit-Hudson, Ohio 

34. Cheyenne ^Mountain Summit-Garden City- 



Meteorological station (Xg) 



Pittsburgh 

North Plattc-Des Moines 

San Antonio 

San Antonio (2), Little Rock (1) 

San Antonio 

Austin 

Joliet-Columbia 

San Antonio 

Atlanta 

Toledo 

Joliet- Cincinnati 

Pittsburgh 

Boston 

Pittsburgh 

Toledo 

Toledo 

Toledo 

Tampa-Miami 

Washington, D.C 

Pittsburgh 

Toledo 

Joliet 

Boston L 

San Antonio 

Atlanta 

Joliet 

Joliet 

San Antonio 

Joliet 

Joliet 

Joliet 

Joliet 

Toledo 

Dodge City-Denver 



Frequency 


Distance 


d 


Mc/s 


km 


mr 


92.9 


155.6 


12.2 


102.9 


150.0 


14.6 


104.5 


283. 1 


32. 4 


105.9 


365.6 


40.4 


102.9 


237.8 


21.0 


94.5 


446.4 


47.4 


93.7 


235.8 


19.3 


96.5 


237.8 


20.6 


101.1 


205. 2 


19.8 


92.3 


195.0 


20.1 


93.7 


223.7 


20.9 


107.9 


224 2 


36.7 


107.5 


197.9 


28.1 


95.7 


146.1 


29.5 


98.7 


201.2 


19.4 


98.7 


201.0 


19.4 


98.7 


201. 2 


19.4 


96.5 


299.0 


27.4 


93.3 


167.5 


12. 


99.7 


188.4 


30.4 


96.3 


181.5 


10.4 


95.5 


202. 8 


16. 1 


96.5 


129. 9 


16.3 


59. 75 


229. 6 


18.3 


215.75 


196.3 


22.3 


71. 75 


203.7 


16.4 


179. 75 


203.2 


16.4 


185. 75 


281.8 


34.6 


191. 75 


204. 4 


17.0 


191. 75 


204.4 


16.8 


191. 5 


204.4 


16. 5 


191. 75 


204.4 


17.1 


179. 75 


179. 9 


10.3 


100.0 


364.5 


30.4 



Broadcast 
day 



0900-2300 

1500-0000 

24 hr 

0800-2300 

0600-0000 
0500-0100 
0600-2000 
0700-2300 
0600-0000 

0700-0100 
0600-2300 
0600-0000 
0700-0000 
0600-2300 
0600-0100 

0600-0100 
0«)00-0100 
0800-0000 
0900-0000 
0700-0100 
0700-0000 
0()()(V 2200 
04(KH)()()0 
07()0-(X)()0 
1000-0000 

C70(H)000 
0900-0000 
1200-2300 
09(XM)10() 
(.900-0100 
090{H)100 
0900-0100 
0700-0100 
24 hr 



Period of 
record 



2-52/r)-53. 
2-51/7-52. 
6-5()/()-53. 
6-51/12-52. 
6-51/12-52. 
5-49/6-51. 
8-51/6-53. 
7-51/6-52. 
6-51/12-52. 
4-51/9-52. 

4-50/6-53. 
7-50/6-52. 
7-51/5-53. 
9-52/5-53. 
5-51/4-53. 
11-50/1-52. 

5-50/6-53. 

5-50/6-53. 

10-52/7-53. 

3-51/10-52. 

6-51/4-53. 

6-50/6-53. 

7-5()/()-52. 

7-51/7-52. 

3-51/(;-53. 

2-51/3-51 c^ 

7-51/6 54 
5-51/5-53. 
7-51 /()-53. 
4-51/6-53. 
7-51/r)-53. 
7-51/6-53. 
9-51/6-53. 
y-51/6-53. 
5-50/6-53. 
6, 7, 9, 10-5 

1, 2, 3-53. 



German Stations 



35. Flensburg-Norderney 


Helgoland ._ 


93. 

93.7 

191.27 

6825. 

400.0 

400.0 

90. 65 

9339. 5 

,516.0 


187 

434 

638 

125.0 

125.0 

125.0 

227. 8 

42.0 

42 


13.9 
38.0 

"28."o' 


0600-2300 
0800-2300 
1100-2300 
24 lir 
24 hr 
24 hr 
24 hr 
24 hr 
24 hr 


4-54/1-55 


36. Wrotbam, Fng.-Krefeld, Germany 


Quakenbrueck... 


11-55/5-57. 


37. Crov'ion, Ktiu. -Darmstadt 


Trier 


11-57/9-58. 


38. Badcii-P.adcMi-Dariiistadt 


Lachen 


9-58/(.)-59 


39. Badeii-liadi'ii-Darmstadt 


Lachcn . 


3-59/11-59. 


40. Baden-Baden-Darmstadt _ .. . 


Lachen . 


3-59/11-59. 


41. Bielstein-Darmstadt . 


Frankfort am Alain- 


7_57/9_5g 


42. Feldbcrg- Darmstadt . _. 


Frankfort am Main... 


10-58/12-59. 


43. Hochblauen-Darmstadt 


Frankfort am Main-Feldberg 


6-59/12-59. 
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